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! . ^ INTRODUCTION 

^ This research attempts to study "sch^i^ effects" by investigating^ 
the unique and common contributions of backgr^uind, mental ability, 
i program and parental involvement variablW^o t^^ reading vocabulary 
and comprehension of students participating in compensatory education, 
: Title I, ESEA, reading programs in Rhode Island. Commonality analysis 
was used as the major analyti^. procedure The major • objective of "this 
paper is to outline, using the study as a practical example, , the pro- 
cedures utilized and interpretations made using partitioning of 
variance- technique. In addition, methods of interpreting negative 

contributions of shared variance will^be delineated. 

^ * ' • ' 

/ 

BACKGROUND 

\ 

Large-scale national evaluations of Title I'^'programs (Glass, 1970; 
Pic^cariello, 1967; Gordon and Kourtpelakos, 1971; General Electric TEMPO 
evaluation, 1968) have produced non-significant results and .concluded 
that the effectiveness of this compensatory education has been|minimal. 
In addition, other r-ecent studies (Coleman et al, 196^; Jencks et al, 
1972, Cicirelli, 1969) have , reported that the effect/ of schooling in 
general is low in comparison to other relevant background variables. 

Coleman's national appraisal of equality of educational opportunity .. 
(1966) found that what is fed into schools in the way of teachers, books, 

building and other resources has much less effect On achievement than the 

students' fWly background^^d the social environment of the "student. 

In other words7lie~"50w^:^d th^schools bring little influence to bear ' 

^ ■ ^ 7 . . ■ ■ ■ 



on a child's achievement that is independent of his background and general 
social context. Further, a study headed by Christopher Jencks (1972) on 
inequality concluded that neither family background, cognitive skill, " 
educational attainment nor occupational status explained much of the 
variance in income of adult men. He also concluded that school reform 
is not likely to have any significant effect on the degree of inequality 
among adults. In addition, Westinghouse/Ohio study of ^Head Start pro- 
> grams conducte^-by Cicirelli et al (1969) concluded that by grade two no 
significant differences were found in readiness scores between those 
who were Head Start participants and those who were non-participants. 

School effects in general, and effects of Title I of ESEA in par- 
ticular, would seem to be 'negligible when taken in the context of large ' 

n^^cro view studies. Large scale investigations, however, have been criti- 

^' . 1 

cized by many (Rotberg and Wolf, 1974; Averch et al, 1972; HEW Report, 

1972; Lobosco, 1974) as less sensitive an'd exact than would be necessary 

y ■ ■ ■( 

to show effects of schooling on students. As the scope narrows^from the 
natfon to the states, more positive results have emerged. State evalu- 
ation reports in California (1972), Colorado (1971) , 'Connecticut (1972) 
and Rhode Island (1970, 1973) indicated strong positive findings. In 
fact, Webb (1972) stated that it appears that more positive impact on 
participating childten can be identified as the unit bf analysis is narrowed 
fjTom the nation to states to local p):ojects. 

While the evaluations of successful local prcjjects suffered from 
shortcomings in generallzalilllty to a broader population, state and 
national evaluations /of Title I effectiveness have suffered from methodo- 
logical and statistical shortcomings. In addition, the large scale evalu- 



ations often failed to take into account a number of background and program 

^' . ' 

variables such as intelligence, community, type of program, instructional 

^' 

time and student-teacher interaction that could make a difference in 
effective Title I reading programs. , , ■ 

This research designed to overcome m^^iy of the problems that 
^^;plagued earlier studies, of Title I. effectiveness. ' This investigation 
provides complete and relatively uniform data and a degree of representa- 
tiveness hard to achieve in mosfc other settings. For instance',' a single 
standardized test was used, information was available^ on selected program, 
^^b^Jkground, mental ability and parental involvement variables, equal ^ ' 
interval unit measures'" were used, and pre-test and post-test information 
was matched for each child. This investigation has proved to be both- 
relatively free of data problems and representative' of the state of ^ 
Rhode Island. 



METHOD ' 

^ ' •/ 

Source of Data 

The sample used in this study included 877 stud^ts in grades 4-6 
enrolled^n Title I remedial or corrective reading programs in the state 
of Rhode Island in FY 1973-74 and for whom there were appropriate .grade . 
level pre-test and post^^^t Gates-MacGinitie Reading Tests vocabulary 



and comprehension ^cor^s. In Rhode Island there has been an option to 
adminis-ter grade level or instructional level testing (e.g., a fifth ' 
grade participant receiving the second grade test). Only those students 
tested at grade level were included in this study. A review by the writeJ:- 
^indicated that the choice to* use grade or instructional testing seemed . 
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random and there appeared to be no differential selection. For example, 

f 

of those communities that are large urban areas approximately half chose 
to test. at grade level. Similarly in those areas that can be classified 
as suburban and rural communities, about half chose to test at grade 
level and the others choise instructional level. There seemed to be no 
regional or size biases in the selection of testing formats. 

Since those valid rec6rds utilized re^Jresented all of the usable 
data for Rhode Island Title I reding programs for grs^s 4-6, the findings 
of this study a^'e statistically generalizable to the entire state where 



grade level testing was employed, 

V . 

Data Collection 



Data used in this study were collec^d as part of tlje usual 
Rhode Island Department of Educations! s Office of Compensatory Programs. 
Throughout the program year information was collected via four state 

Variables Included, in the Study 



The following .variable sets^ere identified: 
Set 1: Background Vairiables 

* 1) Type of community 

2) Sex 

3) Ethnic Group 

/ 4). Prior years in Title I reading programs 

5) type of school attended . 

6) Number of t^imes retained^ in a grade 

Set 2: Mental Ability V^ariables 



1) ^JQ ^ 

2) I\re-test readiipg scores 
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Set 3: Program Variables ' - ^ • • 

I 1) Plipil-teacher ratio 

2) Per-pupil expenditure 

3) Length of project ^ ' . , > 

4) Number of days student was absent ' . - 
^ 5) Mitiimum amount of individual instruction per student per weekj 
* 6) Size of* instructional group for students 

7) .^ Number of children serviced per week 

8) Amount of scheduled preparation time per week with regular 

teacher to discuss students " ' ' ^ ^-^SyAi... 

9) Whether materials were available at. each child's instructionauJ'V- ''^^^ 
levels, ^ • ' ^ ? ' 

10) Whetlfer materials vJere available on time for project- start ^ ^ 

11) Whether teachers selected materials ' ' , ^ U:- >• 

12) ^ Amount of time spent jby teachers per veek developing their ' ^ . -li 

own materials ' ^ "^'i , " ' , 

,^13) Whether pre-s'ervlee or in-service training activities were 
held for^staff 

Set 4: Parental 'involvement: -ir^Viables 



1) _How often pafe^^^VjlPr^ re^pon^i^ for working with students 
5t home. ^'"^ ' - * ^ ^ 

2) l^ether each .p^arent Ws^^^^ least once'during project year 

3) Whether Par^ntslA'3viM^]?:y/(:ommittee made recommendations on 
expenditures of $itla: I' f urids ^ • \ 

__^^) Whether ^5aV^n.ts A'dyisotyAiC^ participated "in the ' 

^ dfevg^opmenfcj of . Title J v^iiC^ti 
5V WHfether Parertts -Advisory ^Cot reviewed Title I applications 

. 6) Whether 'PaT'ertts Ayvisory^'.dbfcmittee made r^mmendations on ^ 
^improvement-;df Title I, pVo^rams > ■ . c> ^ 
• 7) ^Jt^her^ Parents Advisory Committee participated in Title I 

program evaluation T • ' » 

Treatment of the Data :. c?^* ^ 

The partitionii;ig of variance tecHnique in niultiplk ^^ression was 
used to analyze the data. Tatsuoka, (1969) (1971^, stated that the 
major task -in multiple regression is to con^ruct a linear function, 

' Y' - a + b^X.^ + b^X^ . . . • 
so that the sum of the squared deviations (y'/= y)'Z between the predicted 
and actual Y scores on the criterion ^/ariables is as small as {Possible/ 



The efficiency of the multiple regression equation to predict the criterion 
variable may be determined by computing the multiple correlation coefficient 
(i.e., the correlation between the predicted and actual criterion scores)'. 
Classically, prediction studied-* have utilized quantitative, interval 
variables as predictors while artificially categorized variables have been 
used in analysis of variance and analysis of covariance. 

However, Cohen, (19'68) addressed the issue that though analysis of 
variance and analysis of covariance have traditionally been used in 
studies^ of experimentally induced variation and multiple regression 
analysis has been used in studies of natural variation, the systems, in 
the most meaningful sense, are the same. He stressed the flexibility of 
multiple regression techniques in handling both quantitative and quali- .. 
tative predictor variables. . - 

Mood <1971) mentioned that in education it is very difficult to 
create quantitative models of learning with our present limited knowledge 
of such structures and they specific factors related to them. To treat 
educational model building more appropriately he* suggested £he partitioning 
of variance technique in multiple regressioja for sets of variables 



Mood 



gives the following example to illustrate the method: 

"Lej: us suppose that the first m of the^^'s are. intended 
to be indicators of and refer to them as the W -^et of 
x's; let us lump all the other n-m's into another set, 
• and refer to it simply as tiie Y set. We are going to 
^ partition the variance attributable to the regression of 
A on the x*s into three parts - rather we shall use the 
multiple correlation instead of the variance. We first 
xalculate three regressions; 



A on th^W set of x*s only 
A on the Y set of x's only 
A on the whole feet of x*s 
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and let us. suppose that the first removes 20 percent and' 
the raw variance lof A, ^the second removes 55 percent, 
^ and the third removes 60 percent. Now we divide the 

60 percent removed the whole Set, (W -h Y) into three 
parts: 

a -part uniquely associated with W, 5% 
a part uniquely associated with Y, 40% 
^ a part that may be associated with 

either W or Y - 15% 

The part uniquely associated with the W set is calculated 
by subtracting /the proportion removed by the Total (W + Y) 
Set. The reason for attributing this 5 percent uniquely 
to W is simply that the x's in* the Y set removed 55 per- 
cent of the 60 percent removed by the total; on adding the 
W set to the Y set we remove only an extra 5 percent so - 
that it is the patt that must be' uniquely associated with 
W. Similarly, the W set alone removes 20 percent; on 
adding the Y set to it we remove only an additional 40 
^ percent so that it is the part that must be uniquely 
associated with Y. ' . 



TABLE 1 
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20% 


.55% 



Finally, the part that m,ay be associated with either W or Y * ^ 
is calculated by subtracting th^ two unique parts from the ' 
whole-X60% - 5% - -40%) j(Mood, " 1971, p. 194-195)." 

The partitioning of vari^ce technique, as mentioned 'above, allows 
the researcher to determine both unique and common contributions of the 
sets to tlie variance of the criterW variable. This method offers ad- 
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yantag^ over more traditional types of analyses like analysis of -covariance 
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and step-wise multiple regressio^i. Elashof f (1969) stated that analysis 
of covariance should be considered when the investigator believes that 
some outside variable will have a large, distorting effect on the results ' 
and when the assumptions of normality of data and random assignment of 
subjects to treatments are met- She stated that ANCOVA is widely used 
to "adjust" criterion scores such as achievement for the effects of a 
covariate such as ability in order to compare several treatments.. 

The use of step-wise multiple regression allows for the identif ic'ation 
of unique contributions of the variables to the variance of the depende^bt 
variables by determining .the increase in explained variance by adding each 
variable to the regression equation.- It is impossible, however, to 
determine the joint or common contributions of the sets or variables 
through the'-use 6f step.-wise multiple regression^ procedures\ 

Since partitioning of variance is mainly a correlational technique 
tliat can look at joint contributions, as well as unique elements, it seems 
more ajjpropriate to use for educational model building than methbds that . 
statistically control for certain variables or does not allow for detej- 
mination of common contributijDns. 

Other problems have occurred due to the types of scores generated 
as dependent measures. Compensatory education studies at the local, state 
and federal le/els have typically used gain scores on standardized reading 
tests to evaluate the effectiveness of programs. Gain or change scores are 
typically obtained by taking the difference between pre-test and post-test 
^^^^^/^i^ '^^^"^ Several' authors (Bereiter, 1967, McNemar, 1969) 

have indicated that serious problems could- result from use of this type of 
score. ^The^major problem is that difference scores tend to be noticeably 



less reliable than either of the two obtained scores from which they 
were derived. This occurs -because* the^ errors of measurement in both the 
pre-test and post-test score are present in the gain score. Wrightstohe- 
et al Cn.d.) cited a clear exampje of the problem. Assume that a reading 
program is' being evaluated. One form of a standardized reading test • 
was ''used for a pre-test amd another form of that same instrument was 
used ^s a post-test. If the reliability of the pre-test is .90, the 
reliability of the post-test is also .90 and the correlation between 
pre-test and post-test scores is .75, the reliability of the difference 
scores for the iridividuals in the reading program would be .60. Even 
though tl?e two tests used possessed respectable reliability coefficients, 
the resulting gain scores proved somewhat less reliable. 

A farther problem in ^Sing gain scores to measure the effectiveness 
of compensatory education programs is a phenomenon called regression ' 
toward the mean. Regression toward the mean can occur if students are \ 
selected by virtue^ of being- extreme on a test score and that test score 
is also used as the^pre-test. The ext'ent of the regression depends on 
such factors as the reliability of the test, or errors of measurement in 
the particular test used, as well as on how ^extreme the scores of the 
selected group were on the test. When a selected extred^group is 
identified and those scores are used as' the pr^-test scores', any resulting 
gain scores (post-test score minus pre-test scdre) will include both the 
real gain achieved by students as a result of the program as well as 
whatever regression effect has rtaken place. 

To eliminate many of 'the common problems ±ti dependent variables 
typically encountered in comperfbatory education evaluations, the appro-^' 

11 



10 



priate standard scores (M = 50, S = 10). listed in the Gates-MacGinitie 
Reading Tests norming taBles for vocabulary and comprehension were used 
as criterion variables. 

Newton and Spurrell (1967) have described the statistical basis for 
partitioQing of variance (also called element analysis or commonality 
analysis) and have given examples and rules for .choosing primary and 
secondary elements in the ^egression. While they used single variables ' 
as predictors, Mood suggested (1971) sets of variables could also be used. 
The primary elements correspond to unique parts while secondary elements 
refer to common and 'total parts in Table 1 above. Newton and Spurrell 
(1968) have described several examples of the partitioning technique in 
industrial settings .an(i have demonstrated "the power. of felement-analysi.s 
to uncover important features of the problem which' were not apparent f rojn 
the analysis by the more conventional routines. (Newton and Spurrell, 1968, 
p. 171)." . * - 

Three areas of concern should be- noted in relation to commonality 
'analysis. The first deals with the difficulties encountered in testing 
for significance. Mood (1971) stated that one could make the usual F 
test of significance for unique parts to determine whether additional ^ 
regression terms have contributed significantly to the regression. 
^ One cannot, however, test the coimnon parts for significance. \This 

concern is not*a major one here since this large sample study is more 
interested in unique and common contributions of the factors to the 
dependent variables than in statistical significance. 

A second concern deals with the interaction of sets of variables. 
Tatsuokag(l973) stated that the relationships between the joint contri- 
butions of sets of variables should not be copfused with the interaction 
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of these s6ts. ^However., if one were interested in the interaction, the 

7 ' • . . ' ] ■ 

product termomethod could be used^ Kerlinger and-Pedhazur (1973) cited 

>^ ' . • • • 

•an example in the two. variable case. Assuming one h^d two variables, 
-•Xj^'and X^/ the values of these'twb independe^t variables could be multi- 
plied over alL cases to cjfj^ate a third varialjle, X1X2. This variable , is 

■then entered ii*to the regtessibn equation„as anoifher variable, and, if 

■ -'^^ ^ '• ■ " ' 

there is a significant interaction between the variables in their effect 

on the dependent vard^able^ 'it will be evident in the significance .test": 
The analysis used in this study, however, was designed to investigate 
the unique and common contributions of the sets of variables on the 
dependent .rUariable and not the interaction of these factors. 

^ A third concern is that some of the commonalities can have negative 
signs. ^Kerlinger and Pedhazur (1973) stated that negative commonalities 
can be obtained in situations where one of the variables is a suppressor, 
or when correlations among independent variables are negative. Where 
Results of this study indicated negative commonalities, an attempt was 
made to explain the cause. 

Measures in the "school effects" realm are often rather crude and it 
seems doubtful that the indicators would be specific enough to ptovide 
very meaningful data by themselves. Partitioning of variance"" technique 
is especially appropriate to analyze data of this type since it assumes 
that the proportion of variance associated with a factor would have more 
stability than would regression coefficients for the specific variables 
within those factors. Mood offers a concluding rationale using par- 
titioning of variance' for factors rather than multiple regression on 
•individual indicators of that factor by stating the following: 

V ■ 13 . ' ■ ■ 
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"Models involving a great many variables' might be 
more easily comprehended and bett-fer related to 
the work of others If tlie variables are combined 
into relatively few fundamental factors. In 'the 
present state of our understanding of ^ education,^ , 
the factors would have to be selected mostly by 
intuition. 

^ . - 

PartitrLoning of^ regression variarrpe appears to be 
a useful tool for attempting to develop relatively 
independent factors^ and to seek out reasonably 
specific indicators for them. ' 

One line .of ' early development of lea:^ning models 
might confine itself to two or three broad factors. 
When their structure is well understood, the n^xt 
stage of development might attempt to break one 
or. more of those broad factors down into tyq or 
three -less comprehensive factors and use them to 
create more elaborate structures. (Mood,^ 1971, 
pp. 200-201)." 



RESULTS ' ^ ^ . 

The data were analyzed by using the partitioning of variance 
technique in multiple regression to determine the unique and joint 
contributions of four sets. of variables in the reading achievement of 
compensatory education students in Rhode Island. A computer program 
written by Polit and Rakow (1974) at Boston College designed to per- 
form commonality analysis was utilized. Separate analyses were con- 
ducted for vocabulary and comprehension scores. 

Four sets of variables were included in the analyses. The back- 
ground set included six variables. Two variables in the set - type of 
community and ethnic group - necessitated the construction of dummy 
variable coding for these indicators. The mental ability set included 
two variables. The reading program s6t included thirteen variables re 
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lated to insttuctiQjial and program elements. The parental iny&lvemkit 

set included six variables in the analysis. Seven variables were initially 

intended to be used; however, preliminary analyses indica^d a high rela- 

/ ' 
tionship between. two - participation of. Parents Advisory/Committee in 

■ ' '' . . . 

the devei^^fflLof Title I applications and review of Title I applica^ 

tions ,l^.^M^»pP'*Advisory Committee - about +.80, so an additional 



variable;^' /lombining these two was constructed. 
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Vocabulary Analysis 

The first analysis was performed using . the four sets specified 
above with post-test vocabulary standard scores as the dependent 
variable. The total amount of explained variance accounted for by 
the four sets of variables was sixty percent. 

Background Set - 

The unique contribution of the set of six background variables 
to the variance of vocabulary scores was about seven percent. In ' 
addition, the overlap variance, i.e., that variance shared jointly wit;h 
c/ther sets wais about ten percent. 
Mental Ability Set - ' 

The unique contribution of the set of two mental ability variables 
to the variance of vocabulary scores was about thirteen percent. The 
overlap variance associated with this set was about nine percent. 
Program Set - i 

The unique contribution of the set of thirteen program-related 
variables to the, /variance of vocabulary scores was about nine 'percent. 
In addition, the overlap variance for this set equaled about five 
percent. » - - 

\ * ' - 
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Parental Involvement Set - 

The unique contribution of the set o^ si^p^rental ii^volvement 
variables to the variance . in vocabulal*v stores was about nine -percent . 



Also, the' overlap varianc| associated wi^th this set was seven percent. ' ''^'^ 

' ' ' / ' • ■ ' " 

Only unique and. overlap contributions 'havq^been mentioned here; 

however, the complete set of commonalit/y coefficients are presented in 
Table 1. 

Comprehension Analysis 

^The second analysis was perfon/ed using the four sets of variables 
specified and post-test comprehension standard scores as the dependent 
variable. The total amount of exy'^ained variance accounted for by the 
four sets of variables was about /forty-gix percent. ^mS^ ^ 

Background Set - • j , - / ^^^0 

The unique contribution of/ the set of six background variables to 
the variance of comprehension Scores was abput seven percent, while ^ 
the overlap variance associated with the background set was about four 
percent. 

Mental Ability Set 

The unique contribution of the set of two mental ability variables 
to the variance in comprehension scores was about twenty-five percent 
while overlap variance was about four percent. 
Program Set - 

The unique contribution of the set of thirteen program-related 
variables to the variance in comprehension scores was about five 
percent, while the overlap variary;e was slight, about .4 percent. 
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TABLE 1 

PROPORXIDWS OF EXPLAINED VARIANCE OF FOLFR SETS 
U-v OF VARIABLES ON READIi^ VOCABULARY 

i"" V • AFTER PARTITIONING " 



Unique to Set 1, 
(Background) 

Unique to Set 2, 
(Mental Ability) 

Unique to Set 3, 
(Program) 

Unique to Set. 

(Parental Involvement) 

Common to Sets i and 2 

Common to Sets land 3 

Common. to Sets 2 and 3 

Common to' Sets.l and h 

Common to Sets 2 and k 

Common to Sets 3 and k 

Conunon to Sets 1,.2, and 3 

Common to Sets 1, 3, and 

Common to Sets 2, 3, and h 

Common to Sets 1, 2, and h 

Common to Sets 1, 2, 3, and h 



.068^ 



/ 



.0398 
.08I12 



.0580 



. 0031 
-.1003 

.0150 
-.0036 



Sets of Variables 



.1313 



.0398 

,0228 

.0563 

.0031 

.01*66 
.0150 
. 0036 



.0867 



.081*2 
,0228 



.0900 
.0031 
-.1003 
-.OI166 

-.0036 



.091*3 



.058b 
.0563 
.0900 

.1003 

.01*66 
.0150 

,0036 



.1651 .2182 .1362 .1631 



Parental Involvement Set - . - 

The unique contribution of. the set of sixbackground Variables to 
the .varfance in comprehension scores was about four/percent. . The overlap 
variance was about three percent. 

While unique and overlap conTributipns have been presented her6, 
the conlplete* set of coramonalit3r co.ef ficients for th-e'^co^prehension 
analysis are shown^'in Table 2. * 

DISCUSSION ' — 

Before delving into the results of. the study, it is important to 

first mention the methodology used for analysis in tliife and other similar 

studies. While many type^ of analysis are pbssible, the researchers 

doing input-output type studies have oyerwhelmingly chosen regression 

analysis as the primary analytic method! Beaton ,(1973) states, however, 

that regression analysis model seems most useful when the independent ^ 

variables are truly independent in the sense that they can be manipulated 

to a large degree by the experimenter. .. For field studies^ done in a real- 
/ 

life, educational setting, it is extremely unlikely that, given the present 
state of our knowledge about exactly what "works" in education, sets of 
predictors can be identified that are correlated with the criterion 
variable yet independent of each others. 

While partitioning ^f variance technique (also called commonality 
analysis) does not alleviate the problem^of correlations among predictor 
variables, it does offer a decided advantage in specificity. Partitioning 
of variance technique is an attempt to explain the relative predictive 
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TABLE 2 

■ . PROPORTIONS OF EXPLAINED. VARIMCE OF FOUR SETS 
OF VARIABLES ON READING ' COMPREHENSION AFTER 
PARTITIONING 



\ — w — \ 




Sets 


oi!^Variabl 


es 




1 


2 




it 


^ Unique to Set 1, . 
^ ' (Background) 


TP- : — 

.0682 






K 


Unique to Set. 2, 
/ (Mental Ability) 




.2511 






• " Unique to Set 3, - 
(Program) 
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power/.of all predictor variables, both ^niqualy and in combination with 
other variable^-. It is a method of analyzing the variance of a dependent 
variable intd common -and unique variances ^ help identify the relative 
influences of independent variably. : The method is basJsd bn the premise 
that the vari^^ce of the criterion variable which is predicTed from'4^. 
set of c&rrelate^d variables may be partitioned' into the ^pdepen^eiit 
((Igique) and combination (joint) contributions o*f those variables t^'^^, 
the prediction. Beatop (1973) . stated the s^e idea in sta,t±st04WMf^^&. 

„\ ■ '' ' ' ^ ' ' '■' ■ 'i/MllSMW 

The squared multiple correlation ±s broken .up into eleme -^-"''-^ ■"' 

each iriUividual regressor and to each possible cc 



The elements have the' property that the appropriate sums^^rio'i^^ to 



squared multiple ^correlations- with all re'gresSors, but also to the 
squared multiple correlation of any subset, of , variables;^ ^eluding* the 



simple correlations. (Beaton, 1973, p. 2)1" yeli^xi:<:075) stated 
that by identifyfng the proportion of criterion-varil^c^ associate with 
every unique and jolht;' source, all effects are made ..Explicit in an 

■ ^ ' : . ^ :' ' / ^' . // 

unambiguous manner. The uniqiie contribution of variabiles can be thought 

. pfoportipn .of variance "attributed to a particular variable or 
set of variablesj-^above and beyond the vatiance' accounted -for by the 
Gather independent variables or sets in the regression equation. Joint 
contributions of variables can be thought of ^^s the -degree ^tlie overlap 
. of. correlated variables or sets are predictive ofVthe critejion.^M The 
size o§ the overlap reflects the degree of correlation.;^ - 



Vocabulary Analysis - Unique Contribu-tions ; 

The results indicated that the background set .uniqtiely accouht^^ 
for less of the variance (about s^ven percetit) in trie criterion. 



vocabulary achievement standard scores, than any of the other three 
sets. Menta:jj abillt}^, program, and paVentai Involvement sets ^accounted 
uniquely for thirteen, nine, » £ind nine percent respectively. It is 
'interesting to note that the ^background set accounted totally for nearly 
seventeen percent of .the variance, but only seyen percent coutd be 
uniquely, attribute^.' Thus the degree of overlap for the background set 
is relatively large. 

,.5 - ^ 

Averch £t _al (1972) stated that in studies of the input-output 
variety, like this one, background factors are always important deter- 
miners of educatio'hal outqomes.' Why then does background uniquely 
account for so little of the variance in this study? Several possible 
explanations seem plausible. For instance, mos^t of the. studies done 
previously have not used commonality analysis and hence have not looked 
at the "unique" contrition of background variables. This study found 
a fairly l^rge percent of the variance ' accounted for by background, 
however, a relatively small percent of|pariance was found to be uniquely 
attributable to the background set . Another plausible explanation could 
be that the variables included in the background set might not, have been 
complete 'enough. Since the study used data that had already Seen 
collected, it was impossible to gather information on other relevant 
background variables such as parents' educatiq^ial status, occupations 
or income level. 

While this information would certainly have added to the completenes 
of the variable set, the differences produced by adding such variables 
should be less in an^.^nvestigation dealing with compensatory education 
Students rather than in a study involving general ^pulation subjects. 
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Title I participants must, by law, resid^n areas of their community 
designated as low income target-areas. The relatively low unique values 
for background were much less than' those anticipated by this researcher/ 
The variance uniquely attributable to the instructional program set 
and the parental involvement set were rather high. Some authors, . . " 

Averch jet al (1972) and Summers and Wolfe (1974), have stated that 
numerous studies have indicated that school, resources do not appear to 
exert a strong influence on student educational outcomes. The Summers ^ 
and Wolfe study (19.74) »does offer some hope by isolating class size, ^ 
school size, ^teacher experience, and ratings of colleges attended as 
variables that appear to make a difference in student outcomes. 
Physical characteristics of schools as well as characteristics of 
personnel further removed from the students, like principals, do not 
appear to be powerful determiners. Few studies have examined finer 
distinctions like the actual program and parent involvement variables ""^""^ 
utilized in this investigation. Since both the program and parental 
involvement variables show relatively high contributions and are directly ' 
related to programmatic details, it may well be that as researchers 
begin to identify inputs that more directly impinge upon students like 
instructional grouping, instructional materials and parental help at home 

that school effects will become more evident. As more appropriate <1 ^ 

analyses are tried, it may be that more subtle differences can be delineated. 

Vocabulary Analysis - Joirit Contributions ' 

Since the partitioning of variance technique is a relatively new 
and developing methodology, there is no clea^cut scheme to utilize in 
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interpreting the joint contributions. Kerlinger and Pedhkzur (1973) 
statedothat the' object of the commonality analysis is to obtain large 
unique values and small joint contributions. With the exception of the 
background set, the other three sets resulted in higher unique values 
than total overlap value'. It is.imp^rtantf to note that negative common- 
alities occurred among some of the hoint contributions in this analysis. 
The problem of negative commonalities and possible explanations for 
their existence are" presented later in this section. 

Comprehension Analysj!s - Unique Contributions, 

As in the first analysis,, this analysis using comprehension subtest 
st^dard scores as the dependent variable, the background tet seemed 
to be less influential than originally expected, accounting for about 
seven percent of the variance in comprehension scores. Plausible ex- 
planations such as lack of additional pertinent background information 
or the use of the more detailed analysis may be affecting the results. 
^ Relatively^imiiar uniqup, contributions were found for the program 
and parental involvement sets, five, and four respectively. While these 
values are smaller than those foynd" in the first. analysis, they are 
fairly close to the background set and, therefore, are taken into consider 
ation here. 

The largest value, by far, however, was for the mental ability 
set. Twenty-five percent of the variance was uniquely accounted for 
by this set. The findings cOTild be '^'important when the type of method 
used by the test to measure reading comprehension is considered.- 
Traditionally, the post-question technique .has been used to measure 
reading comprehension. The post-question technique emp^igsizes the mental 
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function of memory as the prime factor^in comprehension. This may 
account for the relatively high oorrelations conventionally found 
between intelligence and reading comprehension ability. The Gates- 
MacGiniMe Reading Tests , however, uses a modified cloze technique 
which is designed to measure more language unders(|:anding than memory 
function. This research may provide some data about the relationship 
between intelligence and comprehension as measured by cloze techniques. 

Comprehension Analysis - Joint Contribut ions 

The commonalities or joijlt contributions of the sets were^ extremely 
small in relation to the unique values, a result, the overlap variance 

for each set is relatively small. 



Negative Commonalities 

/ 

When partitioning of variance technique is used," there exists the 
possibility of obtaining negative commonalities, that is, to obtain 
. negative proportions of shared variance. Beaton (1974) stated that the 
unique elements must be non-negative but the common parts may be either 
positive, negative or zero. He also mentioned that negative commonalities 
are not usually found in -educational research. This stat~^ment may be 
a bit premature since partitioning of variance technique has been used 
in relatively few educational studies and has only recently been identified 
as a promising method in educational research. 

The results of this study indicated some negative commonalities, '' 
most notably a -.1003 value for the joint contributions of the back- 
ground, program and parental involvement sets in the vocabulary analysis. 
The interpretation of negative commonalities is not clear since the 
methodology is still in the developing .stages. ^ 
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Negative commona^rtles are clearly possible in ^partitioning of 
variance. A hypothetical example should make this evident. Assume 
the two variable case, where Variable A and Variable B are .used to 
predict the criterion Variable C^, with the following squaxred multiple 
correlations: R^^^ = .50, R^^^ = .00, R^^g = .40, and R^^^^ = -60. 
To determine the unique contribution of variable A, the following 
formula could be used: • . ^ 

^A = - ?^BC + R\bC = - -00 + .60 = .60. 
To determine the unique contributions of varia-ble B, the following formula 
could be used: . ^ 

Ub = - R^AC + R^ABC = \ .50 + .60 = .10. 
The connnon contribution of variables A and B could be determined by the 
following formula: • 

.^AB = R^ABC - Ua - Ub = .60 - .60' - .10 = -.10. 
Tbe -.10 value for r^jpresents a negative proportion of shared 
variance. 

Several authors (Newman and Newman, 1975, Kerlinger and Pedhazur, 
1973) acknowledge this as a conceptual problem yet offer little 
direction or explanation to solve the difficulty. Other writers supply 
more direction and information. 

Veldman (1975a) suggested that in a situation like the one presented 
above a negative- commonality results from a suppressor variable. A 
^suppressor variable is related to^^other predihtor variable yet unre- 
lated to the criterion. Ip, this way the variable suppresses the variance 
In another predictor which is unrelated to the criterion. The prediction 
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of the criterion Is Increased by the inclusion of a suppressor variable 
into the regression equation. 

The correlation matrix of variables was examined for indications of 
^suppressor variables. Several instances of this type of relationship 
were found. * • • , 

Beaton (1973) and Veldman (1975b) have also suggested that negative 
• commonalities can occur when correlations between independent variables 
or sets of variables are negative. In this situation one variable or 
set actually confounds the predictive power. Beaton (1973) gives afi 
example of a relationship of this type: ^ 

"Both weight and speed are important to success as a professional 
football player and each would be moderately correlated with a 
measure of success in football. Weight and speed are presumable 
negatively correlated and would have a negative commonality in 
. predicting success in football. If both weight and speed are 

known, one would expect to make a much better prediction of success 
using both variables to select fast, heavy men rather than just 
selecting the fastest regardless of weight or heaviest regardless 
of speed. Thus the negative commonality indicates that explanatory 
power of either is greater when the other is used (Beaton, 1973 
9. 22)." V , J, 

In order to shed some light on possible negative correlation between 
variables within sets, the correlation matrix was again examined." | 
Examples of this type of relationship were found to exist. 

For purposes of interpreting the negative commonalities found in 
this study several statements and cautions should be made. 

1) The coefficients presented in Tables 1 and 2 are shown to 
the precision of four decimal points. This was done' to 
indicate complete results and in the event that this type of 
precision would be useful to readers of this study; however, 
it is certainly defensible to round off several of the coefficients. 



Er|c . 26 



X ^ 25 

2) If this is done, many of the negative commonalities presented' 
in the tables become essentially zero. After rounding, no 
negative commonalities appear for any second order combination, 
only in the third order joint contributions. 

3) Given the nature of the variable sets as well as some indica- 
tions from the correlation matrix that negative correlations 
betwe.en some variables exist, it is the opinion of this writer 
that the negative commonalities are more likely to be due to 
negative correlations between sets than in suppressors. In 
many cases variables in each set of predictors were related 

. positively to the dependent variables but negative correla- 
te * 

tions between variables in different sets existed. 
' 4) When interpreting tables, Veldman (1975b) suggested that when 
negative commonalities are obtained, the independent contri- 
butions of the ^ts or variables involved are collectively 
overestimated. ' 
5) Perhaps as educational models become better defined, the 

occurrence of negative commonalities will diminish. However, as 
commonality analysis is increasingly utilized, further research 
and guidelines on interpretation of these scores should be 
developed. 

In conclusion, this investigation utilized a newly developed .methodo- 
logy, commonality analysis, in a school ef f ects ^study . The technique 
provided several advantages oVer more traditional types of analysis and 
Iproved highly satisfactory in the study, it is hoped that this method 
will be increaslugly used in future educational research investigations. 
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